Goto

Collaborating Authors

 Allen County


Methods for Matching English Language Addresses

Ramani, Keshav, Borrajo, Daniel

arXiv.org Artificial Intelligence

Addresses occupy a niche location within the landscape of textual data, due to the positional importance carried by every word, and the geographical scope it refers to. The task of matching addresses happens everyday and is present in various fields like mail redirection, entity resolution, etc. Our work defines, and formalizes a framework to generate matching and mismatching pairs of addresses in the English language, and use it to evaluate various methods to automatically perform address matching. These methods vary widely from distance based approaches to deep learning models. By studying the Precision, Recall and Accuracy metrics of these approaches, we obtain an understanding of the best suited method for this setting of the address matching task.


KoLA: Carefully Benchmarking World Knowledge of Large Language Models

Yu, Jifan, Wang, Xiaozhi, Tu, Shangqing, Cao, Shulin, Zhang-Li, Daniel, Lv, Xin, Peng, Hao, Yao, Zijun, Zhang, Xiaohan, Li, Hanming, Li, Chunyang, Zhang, Zheyuan, Bai, Yushi, Liu, Yantao, Xin, Amy, Lin, Nianyi, Yun, Kaifeng, Gong, Linlu, Chen, Jianhui, Wu, Zhili, Qi, Yunjia, Li, Weikai, Guan, Yong, Zeng, Kaisheng, Qi, Ji, Jin, Hailong, Liu, Jinxin, Gu, Yu, Yao, Yuan, Ding, Ning, Hou, Lei, Liu, Zhiyuan, Xu, Bin, Tang, Jie, Li, Juanzi

arXiv.org Artificial Intelligence

The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations. Rather than merely exploring the breadth of LLM abilities, we believe meticulous and thoughtful designs are essential to thorough, unbiased, and applicable evaluations. Given the importance of world knowledge to LLMs, we construct a Knowledge-oriented LLM Assessment benchmark (KoLA), in which we carefully design three crucial factors: (1) For ability modeling, we mimic human cognition to form a four-level taxonomy of knowledge-related abilities, covering $19$ tasks. (2) For data, to ensure fair comparisons, we use both Wikipedia, a corpus prevalently pre-trained by LLMs, along with continuously collected emerging corpora, aiming to evaluate the capacity to handle unseen data and evolving knowledge. (3) For evaluation criteria, we adopt a contrastive system, including overall standard scores for better numerical comparability across tasks and models and a unique self-contrast metric for automatically evaluating knowledge hallucination. We evaluate $21$ open-source and commercial LLMs and obtain some intriguing findings. The KoLA dataset and open-participation leaderboard are publicly released at https://kola.xlore.cn and will be continuously updated to provide references for developing LLMs and knowledge-related systems.


Blaming video games for school shootings may reflect racist beliefs, study says

Daily Mail - Science & tech

People have long blamed video games as a cause of school shootings, but a new study has found that this is more likely to be the case if the perpetrator is white. Researchers have found that video games are eight times more likely to be mentioned when the perpetrator was a white male than if the shooter were an African American male. Experts believe the public looks to find an explanation for this type of behavior if the act is carried out by someone who doesn't match the racial stereotype of a violent person. Although many politicians and media outlets point to violent video games as the cause of school shootings, experts have yet to find scientific evidence to support these claims. 'Video games are often used by lawmakers and others as a red herring to distract from other potential causes of school shootings,' said lead researcher Patrick Markey, PhD, a psychology professor at Villanova University.


Steam has just confirmed a 'jaw-dropping' decision to sell VR porn video games

Daily Mail - Science & tech

Gaming retailer Steam will continue to allow controversial content on its online store, the company has confirmed. The announcement comes less than a month after Steam was heavily criticised for allowing a school shooting simulator, which allowed players to take on the role of a gunman on a murderous rampage inside a school, on its online store. Steam eventually pulled the video game, dubbed'Active Shooter', after more than 271,900 people signed an online petition calling for its removal. The move appears to have prompted the online retailer, which is owned by Valve, to review its screening policy. Steam has now confirmed that it will not remove any content from its online store simply because some users deem it to be in bad taste.


Active Shooter video game that lets children play as a gunman in a school shooting is finally pulled

Daily Mail - Science & tech

A blood-thirsty video game that encouraged players to take part in a school shooting has been pulled by the publisher after it triggered a furious backlash. 'Active Shooter' was marketed on its ability to allow players to take on the role of a gunman on a murderous rampage inside a school, as well as a SWAT team member trying to stop the bloodshed. As the lone gunman, players would be shown a tally of the number of civilians and police officers they managed to kill during their simulated shooting spree. Anti-gun violence charity Infer Trust described the game as'horrendous' and in'bad taste' given the recent mass shootings in the US. An online petition calling for the game to be scrapped gained more than 194,700 signatures.


Active Shooter video game that lets children simulate murdering their classmates sparks outrage

Daily Mail - Science & tech

A blood-thirsty new video game that encourages players to take part in a school shooting has triggered outrage online. The upcoming game, Active Shooter, lets players choose between taking on the role of a SWAT team member trying to stop an ongoing school shooting -- or the role of the shooter themselves. Those who play as the shooter will be shown a tally of the number of civilians and police officers they have managed to kill during their simulated shooting spree. Anti-gun violence charity Infer Trust has described the game as'horrendous' and in'bad taste' given the recent mass shootings in the US. Players in'Active Shooter' will be shown a tally of the number of civilians and police officers they have killed during their simulated school shooting spree'Pick your role, gear up and fight or destroy!' the description on the Active Shooter listing declares. 'Only in "Active Shooter", you will be able to pick the role of an Elite S.W.A.T team member or the actual shooter.